automatic machine learning
Tetra-AML: Automatic Machine Learning via Tensor Networks
Naumov, A., Melnikov, Ar., Abronin, V., Oxanichenko, F., Izmailov, K., Pflitsch, M., Melnikov, A., Perelshtein, M.
Neural networks have revolutionized many aspects of society but in the era of huge models with billions of parameters, optimizing and deploying them for commercial applications can require significant computational and financial resources. To address these challenges, we introduce the Tetra-AML toolbox, which automates neural architecture search and hyperparameter optimization via a custom-developed black-box Tensor train Optimization algorithm, TetraOpt. The toolbox also provides model compression through quantization and pruning, augmented by compression using tensor networks. Here, we analyze a unified benchmark for optimizing neural networks in computer vision tasks and show the superior performance of our approach compared to Bayesian optimization on the CIFAR-10 dataset. We also demonstrate the compression of ResNet-18 neural networks, where we use 14.5 times less memory while losing just 3.2% of accuracy. The presented framework is generic, not limited by computer vision problems, supports hardware acceleration (such as with GPUs and TPUs) and can be further extended to quantum hardware and to hybrid quantum machine learning models.
An introduction to H2O.ai
If you came here looking for an introduction to water, or a synopsis of the 2003 TV series about teenage mermaids you have sadly come to the wrong place. The H2O that we will talk about is H2O.ai, a company which develops products for easy, scalable, machine learning and artificial intelligence. Machine learning and artificial intelligence (or AI for short) are topics which have had a lot of interest over the past 4-5 years. Some of this interest has come from businesses as they begin to utilise the information they collect on a day-to-day basis to streamline/automate processes or gain insight. A lot of companies are now looking to hire data scientists/engineers and in turn this is making a lot more people interested in machine learning and AI.
Exploring the Next Frontier of Automatic Machine Learning with H2O Driverless AI - Open Source Leader in AI and ML
At H2O.ai, it is our goal to democratize AI by bridging the gap between the State-of-the-Art (SOTA) in machine learning and a user-friendly, enterprise-ready platform. We have been working tirelessly to bring the SOTA from Kaggle competitions to our enterprise platform Driverless AI since its very first release. The growing list of Driverless AI features and our growing team of Kaggle Grandmasters and industry expert data scientists can be seen as our effort and commitment to achieve that goal. Today, we are excited to announce the availability of our latest Driverless AI release 1.9 which comes with tons of new features. This article is the first of the 1.9 release blog series.
An Auto-ML Framework Based on GBDT for Lifelong Learning
Chai, Jinlong, Chang, Jiangeng, Zhao, Yakun, Liu, Honggang
Automatic Machine Learning (Auto-ML) has attracted more and more attention in recent years, our work is to solve the problem of data drift, which means that the distribution of data will gradually change with the acquisition process, resulting in a worse performance of the auto-ML model. We construct our model based on GBDT, Incremental learning and full learning are used to handle with drift problem. Experiments show that our method performs well on the five data sets. Which shows that our method can effectively solve the problem of data drift and has robust performance.
Automatic Machine Learning by Pipeline Synthesis using Model-Based Reinforcement Learning and a Grammar
Automatic machine learning is an important problem in the forefront of machine learning. The strongest AutoML systems are based on neural networks, evolutionary algorithms, and Bayesian optimization. Recently AlphaD3M reached state-of-the-art results with an order of magnitude speedup using reinforcement learning with self-play. In this work we extend AlphaD3M by using a pipeline grammar and a pre-trained model which generalizes from many different datasets and similar tasks. Our results demonstrate improved performance compared with our earlier work and existing methods on AutoML benchmark datasets for classification and regression tasks.
Automatic Machine Learning by Pipeline Synthesis using Model-Based Reinforcement Learning and a Grammar
Drori, Iddo, Krishnamurthy, Yamuna, Lourenco, Raoni, Rampin, Remi, Cho, Kyunghyun, Silva, Claudio, Freire, Juliana
Automatic machine learning is an important problem in the forefront of machine learning. The strongest AutoML systems are based on neural networks, evolutionary algorithms, and Bayesian optimization. Recently AlphaD3M reached state-of-the-art results with an order of magnitude speedup using reinforcement learning with self-play. In this work we extend AlphaD3M by using a pipeline grammar and a pre-trained model which generalizes from many different datasets and similar tasks. Our results demonstrate improved performance compared with our earlier work and existing methods on AutoML benchmark datasets for classification and regression tasks. In the spirit of reproducible research we make our data, models, and code publicly available.
PECULIUM: Data analytics and Artificial intelligence in crypto-sphere
To answer this question, you need first of all few clues about my background. I am Rachid Oukhai, founder of Upsilon, Peculium (Data). I started working in computer science one Monday morning at 8 a.m. I was so excited about the idea of getting into the professional world of IT, especially at a telecommunication services provider whose advertisements flooded the media landscape at the time. Young and full of enthusiasm, I thought naively that I was going to take part in big decisions, embark on adventures.
#8 Paris Women in Machine Learning & Data Science Paris ML Hors-Série: H2O.ai,
For the very first time, we organized a joint meetup with the Paris Machine Learning group. Ingima kindly welcomed the participants in central Paris. While Erin LeDell, Chief Machine Learning Scientist at H2O.ai, was in Paris to attend an OpenML workshop at INRIA, she kindly accepted to talk during an exceptional "hors-série" meetup. She spoke about "Scalable Automatic Machine Learning with H2O". Erin LeDell's presentation provided a history and overview of the field of Automatic Machine Learning (AutoML), followed by a detailed look inside H2O's AutoML algorithm.
Big Data Tech 2018: Scalable Automatic Machine Learning with...
In this presentation, Erin LeDell (Chief Machine Learning Scientist, H2O.ai), will provide an overview of the field of "Automatic Machine Learning" and introduce the new AutoML functionality in H2O. H2O's AutoML provides an easy-to-use interface which automates the process of training a large, comprehensive selection of candidate models and a stacked ensemble model which, in most cases, will be the top performing model in the AutoML Leaderboard. Erin will also provide simple code examples to get you started using AutoML.